2023
Conference article
Open Access
Social and hUman ceNtered XR
Vairo C., Callieri M., Carrara F., Cignoni P., Di Benedetto M., Gennaro C., Giorgi D., Palma G., Vadicamo L., Amato G.
The Social and hUman ceNtered XR (SUN) project is focused on developing eXtended Reality (XR) solutions that integrate the physical and virtual world in a way that is convincing from a human and social perspective. In this paper, we outline the limitations that the SUN project aims to overcome, including the lack of scalable and cost-effective solutions for developing XR applications, limited solutions for mixing the virtual and physical environment, and barriers related to resource limitations of end-user devices. We also propose solutions to these limitations, including using artificial intelligence, computer vision, and sensor analysis to incrementally learn the visual and physical properties of real objects and generate convincing digital twins in the virtual environment. Additionally, the SUN project aims to provide wearable sensors and haptic interfaces to enhance natural interaction with the virtual environment and advanced solutions for user interaction. Finally, we describe three real-life scenarios in which we aim to demonstrate the proposed solutions.Source: Ital-IA 2023 - Workshop su AI per l'industria, Pisa, Italy, 29-31/05/2023
Vairo C., Callieri M., Carrara F., Cignoni P., Di Benedetto M., Gennaro C., Giorgi D., Palma G., Vadicamo L., Amato G.
The Social and hUman ceNtered XR (SUN) project is focused on developing eXtended Reality (XR) solutions that integrate the physical and virtual world in a way that is convincing from a human and social perspective. In this paper, we outline the limitations that the SUN project aims to overcome, including the lack of scalable and cost-effective solutions for developing XR applications, limited solutions for mixing the virtual and physical environment, and barriers related to resource limitations of end-user devices. We also propose solutions to these limitations, including using artificial intelligence, computer vision, and sensor analysis to incrementally learn the visual and physical properties of real objects and generate convincing digital twins in the virtual environment. Additionally, the SUN project aims to provide wearable sensors and haptic interfaces to enhance natural interaction with the virtual environment and advanced solutions for user interaction. Finally, we describe three real-life scenarios in which we aim to demonstrate the proposed solutions.Source: Ital-IA 2023 - Workshop su AI per l'industria, Pisa, Italy, 29-31/05/2023
See at:
ceur-ws.org 
| ISTI Repository | ISTI Repository | CNR ExploRA
2023
Conference article
Unknown
The Dynamic Collections project: providing structured online access to digital replicas
Berggren Å, Callieri M., Dell'Unto N., Derudas P., Dininno D., Ekengren F., Naponiello G.
This contribution will present the latest results of the Dynamic Collections project, highlighting the evolution of the approach, methodologies and tools. The core idea behind the project was to explore the possibilities of working online, for teaching and study purposes, with high-resolution digital replicas of archaeological artefacts, going beyond the single-object approach. To this aim, the project built an archive of high-resolution digital models, and designed and implemented an online platform that makes it possible to build, annotate and share a custom assemblage of the objects in the archive (a Dynamic Collection, that is). These annotated collections can be the pivot element in the definition of collaborative workflows and shared research/teaching environments.Source: METROARCHEO 2023 - 2023 IMEKO TC-4 International Conference on Metrology for Archaeology and Cultural Heritage, Rome, Italy, 19-21/10/2023
Berggren Å, Callieri M., Dell'Unto N., Derudas P., Dininno D., Ekengren F., Naponiello G.
This contribution will present the latest results of the Dynamic Collections project, highlighting the evolution of the approach, methodologies and tools. The core idea behind the project was to explore the possibilities of working online, for teaching and study purposes, with high-resolution digital replicas of archaeological artefacts, going beyond the single-object approach. To this aim, the project built an archive of high-resolution digital models, and designed and implemented an online platform that makes it possible to build, annotate and share a custom assemblage of the objects in the archive (a Dynamic Collection, that is). These annotated collections can be the pivot element in the definition of collaborative workflows and shared research/teaching environments.Source: METROARCHEO 2023 - 2023 IMEKO TC-4 International Conference on Metrology for Archaeology and Cultural Heritage, Rome, Italy, 19-21/10/2023
See at: CNR ExploRA
2023
Conference article
Open Access
The dynamic collections - a 3D web platform of archaeological artefacts designed for data reuse and deep interaction
Callieri M., Berggren Å, Dell'Unto N., Derudas P., Dininno D., Ekengren F., Naponiello G.
The Dynamic Collections project is an ongoing initiative pursued by the Visual Computing Lab ISTI-CNR in Italy and the Lund University Digital Archaeology Laboratory-DARKLab, Sweden. The aim of this project is to explore the possibilities offered by a deep, structured interaction with a large set of digital replicas of archaeological artefacts. The project developed and deployed a web-based platform containing a large number of digital artefacts, and a set of dedicated tools to interact with them at a both artefact- and collection-level. This platform has been used in university courses and research activities with positive feedback from the community. In this contribution, we want to describe various aspects of the management of the project, its evolution, and discuss the roadmap of future developments and research directions.Source: CAA 2023 - 50th Computer Applications and Quantitative Methods in Archaeology Conference, Amsterdam, The Netherlands, 3-6/04/2023
DOI: 10.5281/zenodo.8305189
Metrics:
Callieri M., Berggren Å, Dell'Unto N., Derudas P., Dininno D., Ekengren F., Naponiello G.
The Dynamic Collections project is an ongoing initiative pursued by the Visual Computing Lab ISTI-CNR in Italy and the Lund University Digital Archaeology Laboratory-DARKLab, Sweden. The aim of this project is to explore the possibilities offered by a deep, structured interaction with a large set of digital replicas of archaeological artefacts. The project developed and deployed a web-based platform containing a large number of digital artefacts, and a set of dedicated tools to interact with them at a both artefact- and collection-level. This platform has been used in university courses and research activities with positive feedback from the community. In this contribution, we want to describe various aspects of the management of the project, its evolution, and discuss the roadmap of future developments and research directions.Source: CAA 2023 - 50th Computer Applications and Quantitative Methods in Archaeology Conference, Amsterdam, The Netherlands, 3-6/04/2023
DOI: 10.5281/zenodo.8305189
Metrics:
See at:
ZENODO | ISTI Repository | zenodo.org | CNR ExploRA
2023
Contribution to book
Open Access
Digitalizzazione 3D dei frammenti della statua di Athena e del fregio monumentale dell'Athenaion di Castro
Callieri M., Potenziani M., Siotto E.
Nell'ottobre 2021, diversi frammenti della statua di Athena e del fregio monumentale dell'Athenaion di Castro sono stati digitalizzati in modelli 3D a cura del Visual Computing Lab dell'Istituto di Scienza e Tecnologie dell'Informazione (ISTI), CNR. Il personale del laboratorio di ricerca, che si occupa di grafica 3D e di tecnologie digitali applicate ai beni culturali, ha lavorato presso i locali del museo archeologico e dei depositi del comune di Castro nel contesto del Programma di Accesso Molab 2021 del progetto E-RHIS.it.Source: ATHENAION - Tarantini, Messapi e altri nel Santuario di Atena a Castro, edited by Francesco D'Andria, Eva Degl'Innocenti, Maria Piera Caggia, Tommaso Ismaelli, Lorenzo Mancini, pp. 189–192. Bari: EDIPUGLIA, 2023
Callieri M., Potenziani M., Siotto E.
Nell'ottobre 2021, diversi frammenti della statua di Athena e del fregio monumentale dell'Athenaion di Castro sono stati digitalizzati in modelli 3D a cura del Visual Computing Lab dell'Istituto di Scienza e Tecnologie dell'Informazione (ISTI), CNR. Il personale del laboratorio di ricerca, che si occupa di grafica 3D e di tecnologie digitali applicate ai beni culturali, ha lavorato presso i locali del museo archeologico e dei depositi del comune di Castro nel contesto del Programma di Accesso Molab 2021 del progetto E-RHIS.it.Source: ATHENAION - Tarantini, Messapi e altri nel Santuario di Atena a Castro, edited by Francesco D'Andria, Eva Degl'Innocenti, Maria Piera Caggia, Tommaso Ismaelli, Lorenzo Mancini, pp. 189–192. Bari: EDIPUGLIA, 2023
See at:
edipuglia.it | ISTI Repository | CNR ExploRA
2023
Conference article
Open Access
Computational design of fabricable geometric patterns
Scandurra E., Laccone F., Malomo L., Callieri M., Cignoni P., Giorgi D.
This paper addresses the design of surfaces as assemblies of geometric patterns with predictable performance in response to mechanical stimuli. We design a family of tileable and fabricable patterns represented as triangle meshes, which can be assembled for creating surface tessellations. First, a regular recursive subdivision of the planar space generates different geometric configurations for candidate patterns, having interesting and varied aesthetic properties. Then, a refinement step addresses manufacturability by solving for non-manifold configurations and sharp angles which would produce disconnected or fragile patterns. We simulate our patterns to evaluate their mechanical response when loaded in different scenarios targeting out-of-plane bending. Through a simple browsing interface, we show that our patterns span a variety of different bending behaviors. The result is a library of patterns with varied aesthetics and predefined mechanical behavior, to use for the direct design of mechanical metamaterials. To assess the feasibility of our approach, we show a pair of fabricated 3D objects with different curvatures.Source: STAG 2023 - Smart Tools and Applications in Graphics 2023 - Eurographics Italian Chapter Conference, pp. 81–91, Matera, Italy, 16-17/11/2023
DOI: 10.2312/stag.20231297
Metrics:
Scandurra E., Laccone F., Malomo L., Callieri M., Cignoni P., Giorgi D.
This paper addresses the design of surfaces as assemblies of geometric patterns with predictable performance in response to mechanical stimuli. We design a family of tileable and fabricable patterns represented as triangle meshes, which can be assembled for creating surface tessellations. First, a regular recursive subdivision of the planar space generates different geometric configurations for candidate patterns, having interesting and varied aesthetic properties. Then, a refinement step addresses manufacturability by solving for non-manifold configurations and sharp angles which would produce disconnected or fragile patterns. We simulate our patterns to evaluate their mechanical response when loaded in different scenarios targeting out-of-plane bending. Through a simple browsing interface, we show that our patterns span a variety of different bending behaviors. The result is a library of patterns with varied aesthetics and predefined mechanical behavior, to use for the direct design of mechanical metamaterials. To assess the feasibility of our approach, we show a pair of fabricated 3D objects with different curvatures.Source: STAG 2023 - Smart Tools and Applications in Graphics 2023 - Eurographics Italian Chapter Conference, pp. 81–91, Matera, Italy, 16-17/11/2023
DOI: 10.2312/stag.20231297
Metrics:
See at:
diglib.eg.org | ISTI Repository | CNR ExploRA
2023
Journal article
Embargo
A digital platform for the centralization and long-term preservation of multidisciplinary scientific data belonging to the Notre Dame de Paris scientific action
Néroulidis A., Pouyet T., Tournon S., Rousset M., Callieri M., Manuel A., Abergel V., Malavergne O., Cao I., Roussel R., Granier X., Rodier X., De Luca L.
This article explores the design, development and deployment of a digital platform for scholarly work at Notre Dame Cathedral and demonstrates the transformative impact of digital technology on heritage disciplines. By merging technology and human expertise, the platform facilitates the creation, integration, sharing, and analysis of extensive scientific data on the multidisciplinary post-fire study of the cathedral. This multi-layered approach includes community building for collaborative efforts, digital tools tailored to different stakeholders, data structuring approaches for managing multidimensional features, and experience-based workflows for documenting, categorising and semantically enriching scientific and restoration data. The overall goal is to introduce an integrated solution for collaborative studies and to promote a digital memory of the collective initiative in accordance with the principles of FAIR for scientific heritage data. This initiative not only supports the research and restoration of Notre Dame, but also serves as a paradigm for future conservation and documentation efforts in the field of cultural heritage.Source: Journal of cultural heritage (2023). doi:10.1016/j.culher.2023.09.016
DOI: 10.1016/j.culher.2023.09.016
Metrics:
Néroulidis A., Pouyet T., Tournon S., Rousset M., Callieri M., Manuel A., Abergel V., Malavergne O., Cao I., Roussel R., Granier X., Rodier X., De Luca L.
This article explores the design, development and deployment of a digital platform for scholarly work at Notre Dame Cathedral and demonstrates the transformative impact of digital technology on heritage disciplines. By merging technology and human expertise, the platform facilitates the creation, integration, sharing, and analysis of extensive scientific data on the multidisciplinary post-fire study of the cathedral. This multi-layered approach includes community building for collaborative efforts, digital tools tailored to different stakeholders, data structuring approaches for managing multidimensional features, and experience-based workflows for documenting, categorising and semantically enriching scientific and restoration data. The overall goal is to introduce an integrated solution for collaborative studies and to promote a digital memory of the collective initiative in accordance with the principles of FAIR for scientific heritage data. This initiative not only supports the research and restoration of Notre Dame, but also serves as a paradigm for future conservation and documentation efforts in the field of cultural heritage.Source: Journal of cultural heritage (2023). doi:10.1016/j.culher.2023.09.016
DOI: 10.1016/j.culher.2023.09.016
Metrics:
See at:
www.sciencedirect.com 
| CNR ExploRA
2023
Contribution to book
Unknown
Digitalizzazione 3D e beni culturali. Una prospettiva a lungo termine
Callieri M., Cignoni P.
Alcune considerazioni sulle rapporto tra Digitalizzazione 3D e Beni Culturali in una prospettiva a lungo termineSource: I Grandi Maestri della Grecia Antica: FIDIA, edited by Claudio Parisi Presicce, pp. 257–259. Roma: L'Erma di Bretschneider, 2023
Callieri M., Cignoni P.
Alcune considerazioni sulle rapporto tra Digitalizzazione 3D e Beni Culturali in una prospettiva a lungo termineSource: I Grandi Maestri della Grecia Antica: FIDIA, edited by Claudio Parisi Presicce, pp. 257–259. Roma: L'Erma di Bretschneider, 2023
See at: CNR ExploRA
2022
Journal article
Open Access
On assisting and automatizing the semantic segmentation of masonry walls
Pavoni G., Giuliani F., De Falco A., Corsini M., Ponchio F., Callieri M., Cignoni P.
In Architectural Heritage, the masonry's interpretation is an essential instrument for analysing the construction phases, the assessment of structural properties, and the monitoring of its state of conservation. This work is generally carried out by specialists that, based on visual observation and their knowledge, manually annotate ortho-images of the masonry generated by photogrammetric surveys. This results in vector thematic maps segmented according to their construction technique (isolating areas of homogeneous materials/structure/texture or each individual constituting block of the masonry) or state of conservation, including degradation areas and damaged parts. This time-consuming manual work, often done with tools that have not been designed for this purpose, represents a bottleneck in the documentation and management workflow and is a severely limiting factor in monitoring large-scale monuments (e.g., city walls). This article explores the potential of AI-based solutions to improve the efficiency of masonry annotation in Architectural Heritage. This experimentation aims at providing interactive tools that support and empower the current workflow, benefiting from specialists' expertise.Source: Journal on computing and cultural heritage (Online) 15 (2022). doi:10.1145/3477400
DOI: 10.1145/3477400
Metrics:
Pavoni G., Giuliani F., De Falco A., Corsini M., Ponchio F., Callieri M., Cignoni P.
In Architectural Heritage, the masonry's interpretation is an essential instrument for analysing the construction phases, the assessment of structural properties, and the monitoring of its state of conservation. This work is generally carried out by specialists that, based on visual observation and their knowledge, manually annotate ortho-images of the masonry generated by photogrammetric surveys. This results in vector thematic maps segmented according to their construction technique (isolating areas of homogeneous materials/structure/texture or each individual constituting block of the masonry) or state of conservation, including degradation areas and damaged parts. This time-consuming manual work, often done with tools that have not been designed for this purpose, represents a bottleneck in the documentation and management workflow and is a severely limiting factor in monitoring large-scale monuments (e.g., city walls). This article explores the potential of AI-based solutions to improve the efficiency of masonry annotation in Architectural Heritage. This experimentation aims at providing interactive tools that support and empower the current workflow, benefiting from specialists' expertise.Source: Journal on computing and cultural heritage (Online) 15 (2022). doi:10.1145/3477400
DOI: 10.1145/3477400
Metrics:
See at:
ISTI Repository | dl.acm.org | Journal on Computing and Cultural Heritage | CNR ExploRA
2022
Journal article
Open Access
Design and construction of a bending-active plywood structure: the Flexmaps Pavilion
Laccone F., Malomo L., Callieri M., Alderighi T., Muntoni A., Ponchio F., Pietroni N., Cignoni P.
Mesostructured patterns are a modern and efficient concept based on designing the geometry of structural material at the meso-scale to achieve desired mechanical performances. In the context of bending-active structures, such a concept can be used to control the flexibility of the panels forming a surface without changing the constituting material. These panels undergo a formation process of deformation by bending, and application of internal restraints. This paper describes a new constructional system, FlexMaps, that has initiated the adoption of bending-active mesostructures at the architectural scale. Here, these modules are in the form of four-arms spirals made of CNC-milled plywood and are designed to reach the desired target shape once assembled. All phases from the conceptual design to the fabrication are seamlessly linked within an automated workflow. To illustrate the potential of the system, the paper discusses the results of a demonstrator project entitled FlexMaps Pavilion (3.90x3.96x3.25 meters) that has been exhibited at the IASS Symposium in 2019 and more recently at the 2021 17th International Architecture Exhibition, La Biennale di Venezia. The structural response is investigated through a detailed structural analysis, and the long-term behavior is assessed through a photogrammetric survey.Source: Journal of the International Association for Shell and Spatial Structures 63 (2022): 98–114. doi:10.20898/j.iass.2022.007
DOI: 10.20898/j.iass.2022.007
Metrics:
Laccone F., Malomo L., Callieri M., Alderighi T., Muntoni A., Ponchio F., Pietroni N., Cignoni P.
Mesostructured patterns are a modern and efficient concept based on designing the geometry of structural material at the meso-scale to achieve desired mechanical performances. In the context of bending-active structures, such a concept can be used to control the flexibility of the panels forming a surface without changing the constituting material. These panels undergo a formation process of deformation by bending, and application of internal restraints. This paper describes a new constructional system, FlexMaps, that has initiated the adoption of bending-active mesostructures at the architectural scale. Here, these modules are in the form of four-arms spirals made of CNC-milled plywood and are designed to reach the desired target shape once assembled. All phases from the conceptual design to the fabrication are seamlessly linked within an automated workflow. To illustrate the potential of the system, the paper discusses the results of a demonstrator project entitled FlexMaps Pavilion (3.90x3.96x3.25 meters) that has been exhibited at the IASS Symposium in 2019 and more recently at the 2021 17th International Architecture Exhibition, La Biennale di Venezia. The structural response is investigated through a detailed structural analysis, and the long-term behavior is assessed through a photogrammetric survey.Source: Journal of the International Association for Shell and Spatial Structures 63 (2022): 98–114. doi:10.20898/j.iass.2022.007
DOI: 10.20898/j.iass.2022.007
Metrics:
See at:
ISTI Repository | CNR ExploRA
2022
Conference article
Open Access
Cultural Heritage 3D data on the Web: issues and perspectives
Potenziani M., Ponchio F., Callieri M., Cignoni P., Scopigno R.
Les modèles numériques 3D sont unanimement considérés comme un atout inestimable pour l'étude, la gestion et la promotion du patrimoine culturel. L'urgence de COVID-19 a accéléré la tendance commune à travailler à distance et, pour le patrimoine culturel, la présentation, le partage et l'accès aux données 3D en ligne sont désormais perçus comme une nécessité. Malheureusement, l'absence de méthodologies, d'outils et d'infrastructures standard rend difficile le passage du stockage local à la gestion en ligne de données 3D complexes. Dans cette contribution, nous souhaitons évaluer l'état de l'art de l'utilisation avancée de la 3D sur le web, en soulignant les besoins actuels, en présentant quelques études de cas et en explorant les perspectives futures.Source: Heritage for the Future, Science for Heritage: A European Adventure for Research and Innovation, pp. 378–383, Paris, France, 15-16/03/2022
Potenziani M., Ponchio F., Callieri M., Cignoni P., Scopigno R.
Les modèles numériques 3D sont unanimement considérés comme un atout inestimable pour l'étude, la gestion et la promotion du patrimoine culturel. L'urgence de COVID-19 a accéléré la tendance commune à travailler à distance et, pour le patrimoine culturel, la présentation, le partage et l'accès aux données 3D en ligne sont désormais perçus comme une nécessité. Malheureusement, l'absence de méthodologies, d'outils et d'infrastructures standard rend difficile le passage du stockage local à la gestion en ligne de données 3D complexes. Dans cette contribution, nous souhaitons évaluer l'état de l'art de l'utilisation avancée de la 3D sur le web, en soulignant les besoins actuels, en présentant quelques études de cas et en explorant les perspectives futures.Source: Heritage for the Future, Science for Heritage: A European Adventure for Research and Innovation, pp. 378–383, Paris, France, 15-16/03/2022
See at:
ISTI Repository | www.heritageresearch-hub.eu | CNR ExploRA
2022
Conference article
Open Access
Ebb & flow: uncovering Costantino Nivola's Olivetti sandcast through 3D fabrication and virtual exploration
Ahsan M., Altea G., Bettio F., Callieri M., Camarda A., Cignoni P., Gobbetti E., Ledda P., Lutzu A., Marton F., Mignemi G., Ponchio F.
We report on the outcomes of a large multi-disciplinary project targeting the physical reproduction and virtual documentation and exploration of the Olivetti sandcast, a monumental (over 100m2) semi-abstract frieze by the Italian sculptor Costantino Nivola. After summarizing the goal and motivation of the project, we provide details on the acquisition and processing steps that led to the creation of a 3D digital model. We then discuss the technical details and the challenges that we have faced for the physical fabrication process of a massive physical replica, which was the centerpiece of a recent exhibition. We finally discuss the design and application of an interactive web-based tool for the exploration of an annotated virtual replica. The main components of the tool will be released as open source.Source: GCH 2022 - Eurographics Workshop on Graphics and Cultural Heritage, pp. 85–94, Delft, The Netherlands, 28-30/09/2022
DOI: 10.2312/gch.20221230
Metrics:
Ahsan M., Altea G., Bettio F., Callieri M., Camarda A., Cignoni P., Gobbetti E., Ledda P., Lutzu A., Marton F., Mignemi G., Ponchio F.
We report on the outcomes of a large multi-disciplinary project targeting the physical reproduction and virtual documentation and exploration of the Olivetti sandcast, a monumental (over 100m2) semi-abstract frieze by the Italian sculptor Costantino Nivola. After summarizing the goal and motivation of the project, we provide details on the acquisition and processing steps that led to the creation of a 3D digital model. We then discuss the technical details and the challenges that we have faced for the physical fabrication process of a massive physical replica, which was the centerpiece of a recent exhibition. We finally discuss the design and application of an interactive web-based tool for the exploration of an annotated virtual replica. The main components of the tool will be released as open source.Source: GCH 2022 - Eurographics Workshop on Graphics and Cultural Heritage, pp. 85–94, Delft, The Netherlands, 28-30/09/2022
DOI: 10.2312/gch.20221230
Metrics:
See at:
diglib.eg.org | ISTI Repository | doi.org | CNR ExploRA
2022
Report
Open Access
ARIADNEplus D15.2 - Final report on ARIADNEplus services
Marberg J. F., Bardi A., Vlachidis A., Meghini C., Binding C., Tudhope D., Sinibaldi F., Ponchio F., Mangiacrapa F., Radman-Livaja I., Callieri M., Potenziani M., Lamé M., Assante M., Pagano P., Hermon S., Vassallo V.
This deliverable describes the activities carried out within Work Package 15 (WP15) of the ARIADNEplus project by the different partners and describes the results achieved. The work package consists of several individual tasks and subtasks with the overall goal to develop and provide useful services to archaeologists. This means the work package is by nature heterogeneous with stand-alone tasks and services. Efforts have been made to facilitate collaboration between the individual tasks through joint work package meetings. This has resulted in new cross-task contacts being made, and some sharing of expertise to improve services has been done. A service design template aligning the ARIADNEplus services with the requirements from European Open Science Cloud (EOSC) has been created. In connection with this, the ARIADNEplus AO-CAT ontology has been adapted to the requirements from EOSC Resource Data Model (Task 15.1). The Visual Media Service (Task 15.2.1) has had a new format added, allowing for 2D visualisation of LIDAR data in DEM format. In addition, three other standards have been added: gITF, ThreeJS and IIIF, supporting various functionality in the service. The service has also been adapted to support integration with the ARIADNEplus infrastructure in D4Science. A visual wizard has been defined to guide Visual Media Service users to add hotspots to a 3D scene easily and quickly. This extension, initially implemented in 3DHOP will allow archaeologists to create interactive links from the digital 3D model to the related documentation without writing any source code (Task 15.2.2). Task 15.2.3 reworked the Online 3D Database System for Endangered architectural and archaeological Heritage in the south Eastern MEditerRAnea area (EpHEMERA). EpHEMERA is a service provided by the Cyprus Institute to visualize in 3D archaeological excavations, ancient buildings, and their related documentation. In EpHEMERA, it is possible to visualise, online and through standard web browsers, 3D architectural and archaeological models (classified according to a specific type of risk), query the database system and retrieve metadata attached to each digital object, and extract geometric and morphological information about the Cultural Heritage asset. The visualisation and annotation tool of the TSS project have been ported to the OpenLime library and integrated into the Visual Media Service (Task 15.2.1). An additional layer of SVG annotations have been developed and added to the service. The Annotation service have been used and improved in three different pilot projects. (Task 15.3.2) Various strands of work have been done improving services for text mining and Natural Language Processing (Task 15.4). One of these efforts has been building upon the outcomes of the preceding ARIADNE project. A set of archaeological Named Entity Recognition NLP pipelines were reconfigured and deployed for easier use on the General Architecture for Text Engineering (GATE) cloud. Another effort has been on extracting temporal archaeological information using two different parallel approaches, normalisation and named entity recognition. A Python development platform has been used to unify the various services. A Vocabulary Annotation Tool (Task 15.3.1) was developed using the same platform, as part of Task 15.4. The tool facilitates the locating and tagging of vocabulary terms within free text and outputs suggested subject annotations in a range of formats. The GeoPortal service (Task 15.5) is a new REST service designed to manage complex spatio-temporal documents defined by metadata profiles. It was released as a component of the gCube framework. A prototype using the service was deployed and operated to manage archaeological excavation projects (Task 15.7). Two services for querying the RDF AO-Cat metadata records aggregated by the ARIADNEplus Infrastructure was established (Task 15.6): a full-text index service and a SPARQL endpoint. The full- text index service is based on OpenSearch and supports the needed query functionality of the ARIADNEplus portal. The SPARQL endpoint allows performance of semantic queries on the RDF records within the ARIADNEplus data and knowledge cloud.Source: ISTI Project report, ARIADNEplus, D15.2, 2022
Project(s): ARIADNEplus
Marberg J. F., Bardi A., Vlachidis A., Meghini C., Binding C., Tudhope D., Sinibaldi F., Ponchio F., Mangiacrapa F., Radman-Livaja I., Callieri M., Potenziani M., Lamé M., Assante M., Pagano P., Hermon S., Vassallo V.
This deliverable describes the activities carried out within Work Package 15 (WP15) of the ARIADNEplus project by the different partners and describes the results achieved. The work package consists of several individual tasks and subtasks with the overall goal to develop and provide useful services to archaeologists. This means the work package is by nature heterogeneous with stand-alone tasks and services. Efforts have been made to facilitate collaboration between the individual tasks through joint work package meetings. This has resulted in new cross-task contacts being made, and some sharing of expertise to improve services has been done. A service design template aligning the ARIADNEplus services with the requirements from European Open Science Cloud (EOSC) has been created. In connection with this, the ARIADNEplus AO-CAT ontology has been adapted to the requirements from EOSC Resource Data Model (Task 15.1). The Visual Media Service (Task 15.2.1) has had a new format added, allowing for 2D visualisation of LIDAR data in DEM format. In addition, three other standards have been added: gITF, ThreeJS and IIIF, supporting various functionality in the service. The service has also been adapted to support integration with the ARIADNEplus infrastructure in D4Science. A visual wizard has been defined to guide Visual Media Service users to add hotspots to a 3D scene easily and quickly. This extension, initially implemented in 3DHOP will allow archaeologists to create interactive links from the digital 3D model to the related documentation without writing any source code (Task 15.2.2). Task 15.2.3 reworked the Online 3D Database System for Endangered architectural and archaeological Heritage in the south Eastern MEditerRAnea area (EpHEMERA). EpHEMERA is a service provided by the Cyprus Institute to visualize in 3D archaeological excavations, ancient buildings, and their related documentation. In EpHEMERA, it is possible to visualise, online and through standard web browsers, 3D architectural and archaeological models (classified according to a specific type of risk), query the database system and retrieve metadata attached to each digital object, and extract geometric and morphological information about the Cultural Heritage asset. The visualisation and annotation tool of the TSS project have been ported to the OpenLime library and integrated into the Visual Media Service (Task 15.2.1). An additional layer of SVG annotations have been developed and added to the service. The Annotation service have been used and improved in three different pilot projects. (Task 15.3.2) Various strands of work have been done improving services for text mining and Natural Language Processing (Task 15.4). One of these efforts has been building upon the outcomes of the preceding ARIADNE project. A set of archaeological Named Entity Recognition NLP pipelines were reconfigured and deployed for easier use on the General Architecture for Text Engineering (GATE) cloud. Another effort has been on extracting temporal archaeological information using two different parallel approaches, normalisation and named entity recognition. A Python development platform has been used to unify the various services. A Vocabulary Annotation Tool (Task 15.3.1) was developed using the same platform, as part of Task 15.4. The tool facilitates the locating and tagging of vocabulary terms within free text and outputs suggested subject annotations in a range of formats. The GeoPortal service (Task 15.5) is a new REST service designed to manage complex spatio-temporal documents defined by metadata profiles. It was released as a component of the gCube framework. A prototype using the service was deployed and operated to manage archaeological excavation projects (Task 15.7). Two services for querying the RDF AO-Cat metadata records aggregated by the ARIADNEplus Infrastructure was established (Task 15.6): a full-text index service and a SPARQL endpoint. The full- text index service is based on OpenSearch and supports the needed query functionality of the ARIADNEplus portal. The SPARQL endpoint allows performance of semantic queries on the RDF records within the ARIADNEplus data and knowledge cloud.Source: ISTI Project report, ARIADNEplus, D15.2, 2022
Project(s): ARIADNEplus
See at:
ISTI Repository | CNR ExploRA
2021
Contribution to book
Restricted
Virtual clones for cultural heritage applications
Potenziani M., Banterle F., Callieri M., Dellepiane M., Ponchio F., Scopigno R.
Digital technologies are now mature for producing high quality digital replicas of Cultural Heritage (CH) artifacts. The research results produced in the last decade have shown an impressive evolution and consolidation of the technologies for acquiring high-quality digital 3D models, encompassing both geometry and color (or, better, surface reflectance properties). Some recent technologies for constructing 3D models enriched by a high-quality encoding of the color attribute will be presented. The focus of this paper is to show and discuss practical solutions, which could be deployed without requiring the installation of a specific or sophisticated acquisition lab setup. In the second part of this paper, we focus on new solutions for the interactive visualization of complex models, adequate for modern communication channels such as the web and the mobile platforms. Together with the algorithms and approaches, we show also some practical examples where high-quality 3D models have been used in CH research, restoration and conservation.Source: From Pen to Pixel - Studies of the Roman Forum and the Digital Future of World Heritage, edited by Fortini Patrizia, Krusche Krupali, pp. 225–233. Roma: L'Erma di Bretschneider, 2021
Potenziani M., Banterle F., Callieri M., Dellepiane M., Ponchio F., Scopigno R.
Digital technologies are now mature for producing high quality digital replicas of Cultural Heritage (CH) artifacts. The research results produced in the last decade have shown an impressive evolution and consolidation of the technologies for acquiring high-quality digital 3D models, encompassing both geometry and color (or, better, surface reflectance properties). Some recent technologies for constructing 3D models enriched by a high-quality encoding of the color attribute will be presented. The focus of this paper is to show and discuss practical solutions, which could be deployed without requiring the installation of a specific or sophisticated acquisition lab setup. In the second part of this paper, we focus on new solutions for the interactive visualization of complex models, adequate for modern communication channels such as the web and the mobile platforms. Together with the algorithms and approaches, we show also some practical examples where high-quality 3D models have been used in CH research, restoration and conservation.Source: From Pen to Pixel - Studies of the Roman Forum and the Digital Future of World Heritage, edited by Fortini Patrizia, Krusche Krupali, pp. 225–233. Roma: L'Erma di Bretschneider, 2021
See at:
www.lerma.it | CNR ExploRA
2021
Journal article
Open Access
Sharing archaeological knowledge: the interactive reporting system
Derudas P., Dell'Unto N., Callieri M., Apel J.
This study describes the development of a digital reporting system designed to provide archaeologists with a dynamic and interactive 3D web platform that can be used for describing in great detail records and activities undertaken across a multi-year field investigation campaign. The system was used to compose the archaeological report of a multi-year investigation and employed during the pandemic crisis for supporting digital courses in archaeological practice; the paper also reports the preliminary results of the use of this platform within teaching activities. Unlike other web solutions, this system supports an assisted publication of archaeological contents that integrates a 3D visualization system in the reporting process, exploiting the communicative potentials of 3D models and the web. This study represents a contribution to research on sustainable forms of management and publication of archaeological contents and their reuse and sharing.Source: Journal of field archaeology (2021). doi:10.1080/00934690.2021.1911132
DOI: 10.1080/00934690.2021.1911132
Metrics:
Derudas P., Dell'Unto N., Callieri M., Apel J.
This study describes the development of a digital reporting system designed to provide archaeologists with a dynamic and interactive 3D web platform that can be used for describing in great detail records and activities undertaken across a multi-year field investigation campaign. The system was used to compose the archaeological report of a multi-year investigation and employed during the pandemic crisis for supporting digital courses in archaeological practice; the paper also reports the preliminary results of the use of this platform within teaching activities. Unlike other web solutions, this system supports an assisted publication of archaeological contents that integrates a 3D visualization system in the reporting process, exploiting the communicative potentials of 3D models and the web. This study represents a contribution to research on sustainable forms of management and publication of archaeological contents and their reuse and sharing.Source: Journal of field archaeology (2021). doi:10.1080/00934690.2021.1911132
DOI: 10.1080/00934690.2021.1911132
Metrics:
See at:
ISTI Repository | www.tandfonline.com | Journal of Field Archaeology | CNR ExploRA
2021
Journal article
Open Access
Dynamic collections: a 3D web infrastructure for artifact engagement
Ekengren F., Callieri M., Dininno D., Berggren A., Macheridis S., Dell'Unto N.
Archaeological collections are crucial in heritage studies and are used every day for training archaeologists and cultural heritage specialists. The recent developments in 3D acquisition and visualization technology has contributed to the rapid emergence of a large number of 3D collections, whose production is often justified as the democratization of data and knowledge production. Despite the fact that several 3D datasets are now available online, it is not always clear how the data - once stored - may be engaged by archaeology students, and the possible challenges the students may face in the learning process. The goal of the Dynamic Collections project at Lund University is to develop a novel 3D web infrastructure designed to support higher education and research in archaeology. At the onset of the COVID-19 pandemic in the spring of 2020, all teaching at Lund University moved online, reinforcing the urgency for such an infrastructure. By letting a group of students test an early version of the system as part of their online teaching, we were able to study how they used and interacted with an archaeological collection in 3D and explore the intersection of digital methods and pedagogy in archaeology. This article presents the preliminary results from this experiment.Source: open archaeology 7 (2021): 337–352. doi:10.1515/opar-2020-0139
DOI: 10.1515/opar-2020-0139
Metrics:
Ekengren F., Callieri M., Dininno D., Berggren A., Macheridis S., Dell'Unto N.
Archaeological collections are crucial in heritage studies and are used every day for training archaeologists and cultural heritage specialists. The recent developments in 3D acquisition and visualization technology has contributed to the rapid emergence of a large number of 3D collections, whose production is often justified as the democratization of data and knowledge production. Despite the fact that several 3D datasets are now available online, it is not always clear how the data - once stored - may be engaged by archaeology students, and the possible challenges the students may face in the learning process. The goal of the Dynamic Collections project at Lund University is to develop a novel 3D web infrastructure designed to support higher education and research in archaeology. At the onset of the COVID-19 pandemic in the spring of 2020, all teaching at Lund University moved online, reinforcing the urgency for such an infrastructure. By letting a group of students test an early version of the system as part of their online teaching, we were able to study how they used and interacted with an archaeological collection in 3D and explore the intersection of digital methods and pedagogy in archaeology. This article presents the preliminary results from this experiment.Source: open archaeology 7 (2021): 337–352. doi:10.1515/opar-2020-0139
DOI: 10.1515/opar-2020-0139
Metrics:
See at:
ISTI Repository | www.degruyter.com | CNR ExploRA
2021
Journal article
Open Access
"Ecce Homo" by Antonello da Messina, from non-invasive investigations to data fusion and dissemination
Albertin F., Ruberto C., Cucci C., Callieri M., Potenziani M., Siotto E., Pingi P., Scopigno R., Bettuzzi M., Brancaccio R., Morigi M. P., Castelli L., Taccetti F., Picollo M., Stefani L., De Vita F.
Scientific investigations of artworks are crucial in terms of preservation since they provide a measurable evaluation of the materials and the state of conservation. This is the case of Antonello da Messina's painting "Ecce Homo": its delicate state of conservation, with the need for constant monitoring, required a broad and in-depth diagnostic campaign to support the restorers. The project was carried out entirely in situ using non-invasive cutting-edge techniques and proposes a multimodal and data-centric approach, integrating 3D and 2D methodologies. The surface irregularities and the support were analysed with a structured-light 3D scanner and X-ray tomography. The painting materials were investigated with X-ray fluorescence scanning (MA-XRF) and reflectance hyperspectral imaging (HSI). Primarily, the data were jointly used for a scientific scope and provided new knowledge of the painting in terms of materials and painting techniques. In addition, two web-based interactive platforms were developed: one to provide restorers and experts with a new perspective of the hidden geometries of the painting, and the other targeted at the general public for dissemination purposes. The results of the Ecce Homo scientific analysis were exhibited, using a touch-screen interface, and developed for different user levels, from adults to kids.Source: Scientific reports (Nature Publishing Group) 11 (2021): 15868–15885. doi:10.1038/s41598-021-95212-2
DOI: 10.1038/s41598-021-95212-2
Project(s): E-RIHS PP
Metrics:
Albertin F., Ruberto C., Cucci C., Callieri M., Potenziani M., Siotto E., Pingi P., Scopigno R., Bettuzzi M., Brancaccio R., Morigi M. P., Castelli L., Taccetti F., Picollo M., Stefani L., De Vita F.
Scientific investigations of artworks are crucial in terms of preservation since they provide a measurable evaluation of the materials and the state of conservation. This is the case of Antonello da Messina's painting "Ecce Homo": its delicate state of conservation, with the need for constant monitoring, required a broad and in-depth diagnostic campaign to support the restorers. The project was carried out entirely in situ using non-invasive cutting-edge techniques and proposes a multimodal and data-centric approach, integrating 3D and 2D methodologies. The surface irregularities and the support were analysed with a structured-light 3D scanner and X-ray tomography. The painting materials were investigated with X-ray fluorescence scanning (MA-XRF) and reflectance hyperspectral imaging (HSI). Primarily, the data were jointly used for a scientific scope and provided new knowledge of the painting in terms of materials and painting techniques. In addition, two web-based interactive platforms were developed: one to provide restorers and experts with a new perspective of the hidden geometries of the painting, and the other targeted at the general public for dissemination purposes. The results of the Ecce Homo scientific analysis were exhibited, using a touch-screen interface, and developed for different user levels, from adults to kids.Source: Scientific reports (Nature Publishing Group) 11 (2021): 15868–15885. doi:10.1038/s41598-021-95212-2
DOI: 10.1038/s41598-021-95212-2
Project(s): E-RIHS PP
Metrics:
See at:
Scientific Reports | Scientific Reports | ISTI Repository | Scientific Reports | Scientific Reports | Archivio istituzionale della ricerca - Alma Mater Studiorum Università di Bologna | CNR ExploRA
2021
Contribution to conference
Open Access
Proceedings - Web3D 2021: 26th ACM International Conference on 3D Web Technology
Ganovelli F., Mc Donald C., Banterle F., Potenziani M., Callieri M., Jung Y.
The annual ACM Web3D Conference is a major event which unites researchers, developers, entrepreneurs, experimenters, artists and content creators in a dynamic learning environment. Attendees share and explore methods of using, enhancing and creating new 3D Web and Multimedia technologies such as X3D, VRML, Collada, MPEG family, U3D, Java3D and other technologies. The conference also focuses on recent trends in interactive 3D graphics, information integration and usability in the wide range of Web3D applications from mobile devices to high-end immersive environments.Source: New York: ACM, Association for computing machinery, 2021
DOI: 10.1145/3485444
Metrics:
Ganovelli F., Mc Donald C., Banterle F., Potenziani M., Callieri M., Jung Y.
The annual ACM Web3D Conference is a major event which unites researchers, developers, entrepreneurs, experimenters, artists and content creators in a dynamic learning environment. Attendees share and explore methods of using, enhancing and creating new 3D Web and Multimedia technologies such as X3D, VRML, Collada, MPEG family, U3D, Java3D and other technologies. The conference also focuses on recent trends in interactive 3D graphics, information integration and usability in the wide range of Web3D applications from mobile devices to high-end immersive environments.Source: New York: ACM, Association for computing machinery, 2021
DOI: 10.1145/3485444
Metrics:
See at:
dl.acm.org | ISTI Repository | CNR ExploRA
2020
Journal article
Open Access
Effective annotations over 3D models
Ponchio F., Callieri M., Dellepiane M., Scopigno R.
Annotation support in interactive systems is often considered a simple task by the CG community, since it entails the apparently easy selection of a region and its connection with some information. The reality appears more complex. The scope of this paper is twofold: first, to review the status of this domain, discussing and characterizing several approaches proposed in literature to manage annotations over geometric models; second, to present in detail an innovative solution proposed and assessed in the framework of Cultural Heritage (CH) applications, called ClippingVolumes. At the annotation definition stage ClippingVolumes uses 3D data to characterize the annotation region; subsequently, annotations are visualized by adopting a two-pass rendering solution which uses stencil buffers, thus without introducing new geometric elements, changing the topology or duplicating geometry elements. It solves most of the issues that afflict the current state of the art, such as fragmentation, annotation transfer to multiple representations, and multi-resolution data encoding. The latter is a mandatory requirement to produce efficient web-based systems. We implemented and we fully tested this approach in the framework of a complex system that supports the documentation of CH restoration projects.Source: Computer graphics forum (Online) 39 (2020): 89–105. doi:10.1111/cgf.13664
DOI: 10.1111/cgf.13664
Metrics:
Ponchio F., Callieri M., Dellepiane M., Scopigno R.
Annotation support in interactive systems is often considered a simple task by the CG community, since it entails the apparently easy selection of a region and its connection with some information. The reality appears more complex. The scope of this paper is twofold: first, to review the status of this domain, discussing and characterizing several approaches proposed in literature to manage annotations over geometric models; second, to present in detail an innovative solution proposed and assessed in the framework of Cultural Heritage (CH) applications, called ClippingVolumes. At the annotation definition stage ClippingVolumes uses 3D data to characterize the annotation region; subsequently, annotations are visualized by adopting a two-pass rendering solution which uses stencil buffers, thus without introducing new geometric elements, changing the topology or duplicating geometry elements. It solves most of the issues that afflict the current state of the art, such as fragmentation, annotation transfer to multiple representations, and multi-resolution data encoding. The latter is a mandatory requirement to produce efficient web-based systems. We implemented and we fully tested this approach in the framework of a complex system that supports the documentation of CH restoration projects.Source: Computer graphics forum (Online) 39 (2020): 89–105. doi:10.1111/cgf.13664
DOI: 10.1111/cgf.13664
Metrics:
See at:
ISTI Repository | Computer Graphics Forum | onlinelibrary.wiley.com | CNR ExploRA
2020
Journal article
Open Access
Optimizing object decomposition to reduce visual artifacts in 3D printing
Filoscia I., Alderighi T., Giorgi D., Malomo L., Callieri M., Cignoni P.
We propose a method for the automatic segmentation of 3D objects into parts which can be individually 3D printed and then reassembled by preserving the visual quality of the final object. Our technique focuses on minimizing the surface affected by supports, decomposing the object into multiple parts whose printing orientation is automatically chosen. The segmentation reduces the visual impact on the fabricated model producing non-planar cuts that adapt to the object shape. This is performed by solving an optimization problem that balances the effects of supports and cuts, while trying to place both in occluded regions of the object surface. To assess the practical impact of the solution, we show a number of segmented, 3D printed and reassembled objects.Source: Computer graphics forum (Print) 39 (2020): 423–434. doi:10.1111/cgf.13941
DOI: 10.1111/cgf.13941
Project(s): EVOCATION
Metrics:
Filoscia I., Alderighi T., Giorgi D., Malomo L., Callieri M., Cignoni P.
We propose a method for the automatic segmentation of 3D objects into parts which can be individually 3D printed and then reassembled by preserving the visual quality of the final object. Our technique focuses on minimizing the surface affected by supports, decomposing the object into multiple parts whose printing orientation is automatically chosen. The segmentation reduces the visual impact on the fabricated model producing non-planar cuts that adapt to the object shape. This is performed by solving an optimization problem that balances the effects of supports and cuts, while trying to place both in occluded regions of the object surface. To assess the practical impact of the solution, we show a number of segmented, 3D printed and reassembled objects.Source: Computer graphics forum (Print) 39 (2020): 423–434. doi:10.1111/cgf.13941
DOI: 10.1111/cgf.13941
Project(s): EVOCATION
Metrics:
See at:
onlinelibrary.wiley.com | ISTI Repository | Computer Graphics Forum | CNR ExploRA
2020
Journal article
Open Access
On improving the training of models for the semantic segmentation of benthic communities from orthographic imagery
Pavoni G., Corsini M., Callieri M., Fiameni G., Edwards C., Cignoni P.
The semantic segmentation of underwater imagery is an important step in the ecological analysis of coral habitats. To date, scientists produce fine-scale area annotations manually, an exceptionally time-consuming task that could be efficiently automatized by modern CNNs. This paper extends our previous work presented at the 3DUW'19 conference, outlining the workflow for the automated annotation of imagery from the first step of dataset preparation, to the last step of prediction reassembly. In particular, we propose an ecologically inspired strategy for an efficient dataset partition, an over-sampling methodology targeted on ortho-imagery, and a score fusion strategy. We also investigate the use of different loss functions in the optimization of a Deeplab V3+ model, to mitigate the class-imbalance problem and improve prediction accuracy on coral instance boundaries. The experimental results demonstrate the effectiveness of the ecologically inspired split in improving model performance, and quantify the advantages and limitations of the proposed over-sampling strategy. The extensive comparison of the loss functions gives numerous insights on the segmentation task; the Focal Tversky, typically used in the context of medical imaging (but not in remote sensing), results in the most convenient choice. By improving the accuracy of automated ortho image processing, the results presented here promise to meet the fundamental challenge of increasing the spatial and temporal scale of coral reef research, allowing researchers greater predictive ability to better manage coral reef resilience in the context of a changing environment.Source: Remote sensing (Basel) 12 (2020). doi:10.3390/RS12183106
DOI: 10.3390/rs12183106
Metrics:
Pavoni G., Corsini M., Callieri M., Fiameni G., Edwards C., Cignoni P.
The semantic segmentation of underwater imagery is an important step in the ecological analysis of coral habitats. To date, scientists produce fine-scale area annotations manually, an exceptionally time-consuming task that could be efficiently automatized by modern CNNs. This paper extends our previous work presented at the 3DUW'19 conference, outlining the workflow for the automated annotation of imagery from the first step of dataset preparation, to the last step of prediction reassembly. In particular, we propose an ecologically inspired strategy for an efficient dataset partition, an over-sampling methodology targeted on ortho-imagery, and a score fusion strategy. We also investigate the use of different loss functions in the optimization of a Deeplab V3+ model, to mitigate the class-imbalance problem and improve prediction accuracy on coral instance boundaries. The experimental results demonstrate the effectiveness of the ecologically inspired split in improving model performance, and quantify the advantages and limitations of the proposed over-sampling strategy. The extensive comparison of the loss functions gives numerous insights on the segmentation task; the Focal Tversky, typically used in the context of medical imaging (but not in remote sensing), results in the most convenient choice. By improving the accuracy of automated ortho image processing, the results presented here promise to meet the fundamental challenge of increasing the spatial and temporal scale of coral reef research, allowing researchers greater predictive ability to better manage coral reef resilience in the context of a changing environment.Source: Remote sensing (Basel) 12 (2020). doi:10.3390/RS12183106
DOI: 10.3390/rs12183106
Metrics:
See at:
Remote Sensing | ISTI Repository | Remote Sensing | Remote Sensing | CNR ExploRA